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ABSTRACT 


Optimal Control Theory is revisited. A minimum time 
control rule for a third order regulator is found. A third 
order missile model is developed. Minimum time control is 
applied to the fast reaction missile defense problem. The 
results are compared with Proportional Navigation. The states 
controlled in the minimum time application are the derivatives 
of Line-of-Sight angle and the vertical distance and 


derivatives between missile and the target. 
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I. INTRODUCTION 


The expectation of any missile system is to hit the 
target with high probability; in other words, to make the 
terminal miss distance between the missile and target as small 
as possible. For thousands of years projectile weapons have 
had a lack of control after launching. This is detrimental to 
hit probability. Guided missiles have overcome this situation 
by being controlled after launching. 

Currently, there are three guidance laws for tactical 
missiles. These laws are Pursuit Guidance, Line-of-Sight 
Guidance and Proportional Guidance. A missile can employ one 
or more of these guidance laws. Guidance at the terminal phase 
of the missile flight is most important. 

A point defense system may be required to hit an 
attacking missile that has a speed advantage. Instead of 
following an expensive method such as designing new systems 
against these targets, current systems may be upgraded. 

Present work applies a different control to a surface-to- 
air missile. In Chapter II, a minimum time control problem is 
defined and solved for a third order regulator. In Chapter 
III, the three different missile guidance laws are described. 


Acceleration effects on missile velocity is also explained. In 


Chapter IV, a missile model is formed and the missile/target 
engagement scenario is simulated by using Proportional 
Navigation Guidance. In Chapter V, the third order minimum 
time solution is applied to the missile/target engagement 


simulation. 


Il. MINIMUM TIME CONTROL 


A. OPTIMUM CONTROL 

Control system design is a trial and error process 
utilizing various techniques to reach a desired outcome. 
Classically, the performance of a system is defined in terms 
of time and frequency, i1.e., rise time, overshoot, gain and 
phase margins. However, complex multiple-input, multiple- 
output systems require a more elaborate design than the 
classical design. For example, when controlling the attitude 
of a satellite to minimize fuel consumption, optimal control 
theory is required to design ae satisfactory systen, 
incorporating the complicities of multiple input and output 
variables. Optimal control theory can be defined as: 

"The objective of optimal control theory is to determine 

the control signals that will cause a process to satisfy 

the physical constraints and at the same time minimize 

(or maximize) some performance criterion."[Ref. l:p. 1] 
B. TIME OPTIMAL CONTROL 

ee Problem Definition 

In minimum time problems, the objective is to drive 

a system from an arbitrary initial state to a desired state in 
minimum time. Mathematically, the problem is to transfer a 


system, that is, 


X(Ge= Ax (Eee (6) (2.1) 


HOG) = £(X(C) pga, Cc) (2.2) 


from an arbitrary initial state to a desired state by 


minimizing 


c= | Gag, it, (22) 


Control effort u is constrained by a maximum value, such as 


lu] < N (2.4) 


The final state may be any point in the state-space. 
In this study, the final point is the origin of the state- 
space. When the final state is the origin, in a linear, 
stationary, nth order system as defined in Equation (1.1), the 
problem is referred to as the stationary, linear regulator, 
minimum-time problem. 

Ze Problem Solution 
In this section, minimum time control for single 


input systems will be described. From Pontryagin[1], it is 


known that the performance measurement J defined at Equation 
(2.3) can be minimized by minimizing the Hamiltonian which is 


ine the form of 


H=1 + p7Ax + p7Bu (2.5) 


In this equation, u minimizes the Hamiltonian by 
operating at its maximum value with the opposite sign of its 


coefficient p’B. Thus, u can be written as 


u = -N*xsign(p7B) (2.6) 


An optimal time control can be solved for a systen, 
if all the eigenvalues of A have non-positive parts. The 
control u is called the bang-bang control which occurs at its 
maximum values as either +N or -N. The number of switches 
between these values is at most n-1 times for systems with 
real roots depending on the initial position of the system in 
State space where n is the order of the system. 

For an existing control, there are two trajectories 
possible reaching to the origin; one for u=+N and one for u=- 
N. These are zero trajectory curves that finally carry the 
system to the origin. These trajectories divide the state- 


Space into two parts. 


Some possible optimal trajectories for a second 
order system can be seen in Figure 2.1. The solid line curves 
are the zero trajectory curves. The state of the system above 
these curves follows a parabolic path parallel to the -N zero 
trajectory curve, with the control effort of -N; the state 
below these curves has control effort +N and follows a 
parabolic path parallel to the +N zero trajectory. These 
curves are illustrated with dashed line curves. The control on 
these curves switches once. At points A and B the control 


Switches from +N to -N and at points C and D from -N to +N. 





Figure 2.1 Minimum Time Trajectory Curves 
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If these trajectories are described geometrically in 
terms of state variables, the control function can be defined 
as the switching function. This control function decides the 
Sign of the control and in which conditions the control will 
change its sign in state-space. 

Since the final state is the origin, but the initial 
state is any place in state-space, it is better to solve the 
u in negative time with zero initial conditions. Zero initial 
conditions in negative time define the origin, end point of 
the positive time problem. In this method, all minimum time 
trajectories are defined in a generalized equation in terms of 


states. This process is explained in Reference 1. 


C. TIME OPTIMAL CONTROL EXAMPLE 
As an example, switching law can be found for the 


following third order system. 


u 1 1/5 x, X2 1/s X1 


This system is Similar to the missile model which 
will be described in the following chapters, so the switching 
law which will be solved in this section will be used for the 
minimum time application of the missile problen. 


The state-space of the system is 


*,| fo 1 0 | 0 
X|=10 0 1 1x5] + lolu (2.7) 
x,| [0 0 -ajlx,| {2 


The transfer function of the system is 


— (25) 





Eigenvalues are real and negative, so we can have a 
solution. Since the system is third order, there are at most 
two switches in the control depending on the initial position 
of the system in the state-space. 

1. Uncoupled system 

The switching law for the system defines hyper- 
surfaces in the state-space instead of curves in the state- 
plane for a second order system. Transformation of the system 
into an uncoupled system provides an easier definition for the 
Switching law. This is accomplished by taking a partial 


fraction expansion of the transfer function and defining each 


state with respect to control input and assigning a new state 


vector to each eigenvalue, which is 








x = Gy (2.9) 
Uncoupled state-space is found by following 
Gy = AGy + Bu 
so, 
y = GAGy + G Bu (2.10) 
Description of each state with respect to control is 
2 2 
x,(s) = —Uts)_ . i/a _ i/o’ , i/a* (eed 
s?(s+a) ee Ss Sta 
a) (Doi 
Ss st+a 
x;(s) = (2.13) 
S+O 


ee) oo 
a a2 g2 “10 
Go| ak 1] and Gt=|0 a1 (2.14) 
a a O.-0°-1 
0 0 al 


The uncoupled state-space system is 


Yi 0 1 9Oal>4 9) 


Ys} = 10 O O Yo] + Jiju (2.15) 
2% Problem Solution 
The discretization of the system is 
ge Se 10, 
o = £2((sI-A)4) =/0 1 O (2.16) 
omer e ** 
1 42 
t 2 
A = [oadt = t (2.17) 
0 
t+ (y-e-«t 
a 


Using these discrete time matrices, the discrete state-space 


equation is 


y,(t) 1 £ 0 934 '0) Be 
y(C)| = |OR 90" yen 0))) é u(0) (2 aes) 
NAN 1B) 0 0 ely, (0) 1 (y-e-at 

a 
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The positive time difference equations are 


Vee, 0) + you) c + Su(0) ag (2.19) 
Wace) = y,(0) a u(Q)t (2.20) 
Vaele= y,(0)e °° + HAO) (1 -e°**) (2.21) 


In negative time with zero initial conditions the 


difference equations become 


y,(t) = $u(0) ¢ (2.22) 
tec) = rin) ec (2.23) 
aN GC )e= HAO) (1 -e8*) (220) 


By applying u=+N to the system, we have Table 1 for 
one second intervals. For u=-N, we have Table 2. Zero 
trajectory curves are defined by Tables 1 and 2. 

As a next step, the curves before final switching 
are to be defined. This can be accomplished by equating 
positive time equations to the negative time zero trajectory 


curve equations. 
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TABLE 1 


ZERO TRAJECTORY SET (u=+4N) 





TABLE 2 


ZERO TRAJECTORY SET (u=-N) 


~N (4-628) 
a 
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At the time control switches from u=-N to u=+N, 
negative time equations with control effort u=+N are equal to 
positive time equations with control effort u=-N. These sets 


of equations are 


y,(t) = SN = oe (OO) Se SNe? (2.25) 
y,(t) = -N = y,(0) - Nt (2.26) 
walle) = 2 (1-e%) = y,(0) e*t- (1-e°8*) (2.27) 


At time t the control switches from -N to +N. From Equation 


(2.26) we can get 
a eee ALO (2.28) 


By putting t in Equations (2.27) and (2.28) we have 





2 
0 
N = y,(0) + * Ciadall (2.29) 
a Aa N\ 2N,.N 
0 = e-*e N [y3 (0) | ee eee. Op Ee" (2.30) 
a a a 


By following the same steps, we can solve the set of 
equations for the control switches from +N to -N and obtain 
the family of curves shown in Table 3. A common solution from 


the Table 3 gives the switching law for the uncoupled system. 


a3 


TABLE 3 
SOLUTION SET FOR THE UNCOUPLED SYSTEM 










y2 (0) 


= 0 
N y, ( ) + ON 





4N = y, (0) 


9N = y, (0) 


@y, (0) 





Oe %e * (v3 (0) - 4) + 2 aa 
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From Table 3, it is defined ; 


Ww = signy, (0) + eh ul} (233118) 


2N 





f = y,(0) + ma (2532) 


ee F (2.330 


These common equations define the family of curves which is 


ay2 (0) 


tia) a a Ib-sc00 dl ee) (2.34) 
6 a a 


Equations (2.31-34) give the switching law. The switching 


function for the uncoupled system is 


-za- N -2N, e74N\| (2.35 
u = -~Nsigne _ fy, (0) + 2) + of ~2¥, 288 (2.35) 


This switching equation is for the uncoupled system. 
For the normal state system we need to define the uncoupled 
states in terms of normal states. This can be done by the 


following equation 


ee Guix (2.36) 
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So the uncoupled states are expressed as 


Way > eee 


Yo = AX, + X, (253%) 


Y3 = X; 


From Equations (2.36) and (2.37), the switching law in terms 


of normal states can be written as 


eae we (ax, (0) +x, (0) ) ae 
u = -nesigne N ox, (0) + #8) on{ =24, 2280) (2.38) 
a a a 


Where z,w,f are also in terms of normal states. 

3. Simulation of The Third Order System 
The third order regulator is simulated with the 
Switching law found in the previous section. It is seen that 
the control changes its sign at two times and drives the 
states of the system to the origin. The initial values for the 
Simulation run are x,(0)=-0.5, x,(0)=-0.5, x,(0)=0.5. Figures 
2.3-5 show that the states reach to zero. The control effort 
is in Figure 2.6. After the states reach to the origin, the 
control starts chattering or limit cycles. Since the 
Simulation iS in discrete time, the control moves back and 
forth between plus and minus zero trajectories around the 
origin. This movement causes the limit cycles. The sampling 
rate or time delay in control effort decides the magnitude of 
the limit cycle. Figures 2.6 and 2.7 show the second order 
parabolic relation between states x, x, and x, x,;. System states 


follows a parabolic path in the second order state-plane. 
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Figure 2.2 First State 





Figure 2.3 Second State 
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Figure 2.4 Third state 
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Figure 2.5 Control Effort 
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Figure 2.7 





State-Plane for x, and x, 





State-Plane for x, and x, 
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II. MISSILE GUIDANCE AND CONTROL 


A. INTRODUCTION 

Guided missiles have much importance over other weapons 
because of their high probability of hitting their target. 
This high probability is the result of adjustments in missile 
movements to keep the missile on an intercept course despite 
target movements. The missile acts under commands from the 
guidance and control system. These systems keep the missile on 
an intercept course with the target. The guidance system 


applies the command to the missile body. 


B. GUIDANCE 
An unguided weapon may have an excessive miss distance 
because of the following reasons: 
- Incorrect direction of launching; 
- Perturbation of weapon by weather or wind; 
- Unpredictable movement of the target after launching. 
A good method to reduce miss distance and thus improve 
hit probability, is to use a closed loop system. A general 
form of a closed loop system is shown in Figure 3.1 [Ref 2. p. 
71). All guidance systems are particular examples of the 


general system in Figure 3.1. 
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Figure 3.1 Closed Loop 


Missile position and behavior iS measured by an 
observation instrumentation which may be actually combined in 
the missile itself or may be situated on a remote platform 
such aS a ship or an aircraft. This missile data is fed into 
the guidance computer with target data. The computer 
determines the maneuvers of the missile to improve its chances 
of hitting the target. Steering instructions, such as desired 
lateral acceleration in the pitch and yaw plane, are passed by 
the computer to the control system. The control system moves 
the control surfaces or determines the propulsive thrust. The 


resulting motion of the missile is measured by observation 
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instrumentation. The cycle continues with new observation 


data. 


Cc. TYPES OF GUIDANCE LAW 
is Pursuit Guidance 
Pursuit guidance is established by having the 
missile velocity vector directed toward the target. The 
missile always stays along the line-of-sight from missile to 
the target. This guidance is effective against slow moving or 
oncoming targets which have slow line-of-sight rate;. The 


pursuit guidance is illustrated in Figure 3.2. 


Target position and velocity vector 


Missile position 
and velocity vector 





Figure 3.2 Pursuit Guidance Trajectory 
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2. Line-Of-Sight Guidance 

The objective of a Line-of-Sight guidance system is 
to constrain the missile to lie as nearly as possible on the 
line joining the observation point and the target. This may be 
done by two forms which are called Command Guidance to Line- 
of-Sight and Beam Riding. In beam riding guidance, the target 
tracker maintains its radar beam on the line-of-sight and the 
missile tries to stay on it. In command guidance to line-of- 
sight, the missile receives commands to stay on the beam. In 
Figure 3.3, beam riding line-of-sight is illustrated [Ref. 3]. 

3. Proportional Navigation Guidance 

In this guidance law, the missile moves in such a 
way that its rate of turn is proportional to the rate of turn 
of line-of-sight from the missile to the target. The 
navigation ratio is a fixed or variable ratio between the 
Missile rate of turn and the rate of turn of the line-of- 
sight. This guidance system demands an acceleration command 
perpendicular to the line-of-sight. Since proportional 
navigation anticipates the future position of the target, it 
is effective against maneuvering targets. The proportional 


navigation guidance is illustrated in Figure 3.4 [Ref3}. 


D. CONTROL SYSTEM 
The control system has two important functions; the first 


one 1s to provide a stable flight in all phases of flight and 
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Figure 3.3 Line of Sight Guidance Trajectory 


in every probable disturbance. For example, in the presence of 
wind, the necessary balancing commands to the control surfaces 
come from the control system. The second function is to follow 
the acceleration commands coming from the guidance system to 
keep the missile on an intercept course with the target. 

The acceleration commands are provided by the guidance 
system and applied to the missile by the autopilot in the 
control system. In Figure 3.5a [Ref. 4] an acceleration 
command in j direction in missile coordinate system is seen 
for a missile with a velocity in i direction. The angle 7 is 
measured from the reference axis shown in the figure. Figure 
3.5b [Ref. 4] is the top view of ij plane and shows the effect 


of centripetal acceleration A; in the direction of missile 
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Figure 3.4 Proportional Navigation 


velocity v. The change of velocity vector along j axis can be 
seen in Figure 3.5c. From Figure 3.5c [{Ref. 4], the following 
equation may be written by assuming the change of direction 


happened in At seconds. 


3) 


Be Ae 
A V TE VY (3.51) 


In Equation (3.1), commanded acceleration A, is shown in terms 


of tangentional velocity v and angular rates }. 
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Figure 3.5 Central Acceleration Effect 


26 


IV. MISSILE MODEL AND SIMULATION 


A. ASSUMPTIONS 

For the missile/target engagement scenario it is 
necessary to have a missile model. In the simulation, the 
missile will be considered a point of mass. The simplified 
missile motion equations will be defined under the following 
assumptions. 


- The seeker head angle rate is an estimate of the line- 
of-sight rate. 


- The missile thrust cancels drag. 
- The reference for the flight path angles is the x and 
y plane. 
B. TWO DIMENSIONAL MISSILE TARGET GEOMETRY 
Before looking to the missile model, it 1s advantageous 

to understand the equations of motion in two-dimensional 
geometry. In Figure 4.1, a missile and target geometry is 
shown in x and y directions. Vy and V; are the velocity 
vectors of missile and target, respectively. 7, and 7, are the 
velocity angles from the reference line. The missile flight 
path angle can be expressed as 


V, 
Ye arctan ( var (4.2) 
MX 


o7 


< 
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Figure 4.1 Intercept Geometry For Two Dimensions 


Where V,, is the velocity component in the x direction and Vay 
is the velocity component in the y direction. From the same 


geometry, the target flight path can be expressed as 


v= arctan( 72 | (4.2) 


Where V.,, and V,, are the target velocity components. The range 


between the missile and the target is defined as 
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ig = y (Xp-Xy) 7 + gee © (4.3) 


Where x,, Yr, Xm, Ym are the x and y coordinates of the target 
and the missile. 

o is the angle of line-of-sight from the missile to the 
target. It is defined as 


o0 = Arctan 4 (4.4) 
Kr Xy 


The magnitude of velocity vectors can be defined as 


(4.5) 


Line-of-sight rate (0) is a necessary factor in 
proportional navigation. This data is provided by the seeker 


head. Analytic expression for the line-of-sight rate is 


a = (Xr) (Vay Vay) - (Yo-V) (Vie Vice) (4.6) 
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Cc. MISSILE MODEL 
i. System Signal Flow Graph 
The total system signal flow graph in the x 
Girection is illustrated in Figure 4.2 [Ref. 4}. Since 
proportional navigation will be simulated, the guidance system 
has a seeker head which provides line-of-sight rate, (6). The 
input for the autopilot is the multiplication of the 
navigation ratio and o. The output signals of the autopilot 
are required signals for the missile dynamics. 
25 Guidance system 
In signal flow graph, the guidance system includes 
the seeker head. A seeker head is a homing head mounted on an 
airborne missile. The purpose of the seeker is the tracking of 
the target. This is done by sensing radiation or reflected 
energy from the target. Tracking the target by seeker shows 
the angular direction to the target. 
The signal flow graph of a seeker which is gimballed 
to the missile is shown in Figure 4.2. This seeker points at 
the target by rotating. Applied torques provide rotation 


proportional to the target offbore-sight. This can be written 


Tasers (4279 
Where T is the torque, I is the moment of inertia of the 


seeker head and # is angular acceleration. From Figure 4.2 and 


Equation (4.7) the resulting equation of motion is 
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Figure 4.2 System Flow Graph 
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GD = AGS ae OG (4.8) 


Where K, and K, determine the time constants of the seeker. The 
transfer function of the seeker head from input line-of-sight 
angle (9a) to the output seeker angle (8) can be expressed as 


i). a (4.9) 


0 (Ss) s*?+K,s + K, 


The flow graph of the seeker transfer function is shown in 
Figure 4222 
i Flight Control System 

Previously, it was mentioned that the control system 
provides a stable flight to the missile, and passes the 
guidance system commands to the control surfaces by keeping 
the missile stable. These stability requirements are satisfied 
by the autopilot in the control system. 

The control system causes a lag in the missile 
system. In the present missile simulation model, the autopilot 
is modeled as a first order lag with a time constant, 1l/a. 

4. Missile Dynamics 

The missile can be considered a point mass moving 
under the acceleration commands perpendicular to the missile 
velocity vector. From Figure 4.3, components of acceleration 


can be expressed as: 
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Figure 4.3 Missile Acceleration and Components 


-aySiny 


eames, cosy 


(4.10) 


sy 
i 


The position of the missile in the x and y plane can 
be found by integrating the acceleration components twice. 


Figure 4.4 shows the missile dynamics in two dimensions. 


D. PROPORTIONAL NAVIGATION SIMULATION 
In this section, the missile/target engagement will be 
presented in two different simulations by using proportional 


Simulation. In the first simulation the defensive missile has 


6 a 





Figure 4.4 Missile Dynamics in Two Dimensions 


the speed advantage; in the second simulation the target 


missile has the speed advantage. The following assumptions are 


made for both simulations 


The missile is limited to 20 g’s acceleration. 


The target is on the final leg of its flight and is now 
on a non-maneuvering trajectory, so it has _ no 
acceleration. 


The x and y plane is the reference system for the flight 
paths and angles of the target and the missile. 


The miss distance will be estimated by interpolating the 
two most minimum ranges between the missile and the 
target. 


The navigation ratio is 3.25. Flight constant time 
constant is 1/3 second. 


K, and K, constants in seeker head are 100 and 20, 
respectively. 
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1. Speed Advantage of Missile 
In the first scenario, the defensive missile has the 
speed advantage over the incoming target. The initial 
conditions for the simulation are : 


Vu. (0) = 2000 feet/sec 


X,;(0) = 10,000 feet 
Yr(0) = 1000 feet 
V7,(0) = -1000 feet/sec 


All other initial conditions are zero. As shown in Figure 4.5, 
a successful intercept occurs and the range goes to zero. Miss 
distance is 0.625 feet. Figure 4.6 is a plot for the missile 
and the target flight paths. The target starts its motion from 
10,000 feet distance and moves towards the y axis. The missile 
has an intercept path with the target. Figure 4.7 is a plot 
for the app:ied missile acceleration. Missile acceleration 
components in x and y direction are shown in Figure 4.8. At 
initial phase, maximum acceleration especially in y direction, 
is commanded. The line-of-sight angle is in Figure 4.9. Line- 
of-sight angle rate is shown in Figure 4.10. Initially these 


parameters increase, then decrease until just prior to 


intercept. 
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Figure 4.6 Missile and Target Flight Paths 
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Figure 4.7 Applied Acceleration 
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Figure 4.8 Acceleration components in 
direction 
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Figure 4.10 Line-of-Sight Angle Rate 
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2. Speed Advantage of Target 

In this simulation, the incoming target has the 
speed advantage over the defensive missile. Only the missile 
and target velocities are changed from the previous 
Simulation. The velocities are: 

Vix. (0) = 1000 feet/sec 
V7,(0) = -2000 feet/sec 

All other initial conditions are the same as in the previous 
Simulation. As seen in Figure 4.11, the range goes towards 
zero but with an increasing miss distance. The miss distance 
17.96 feet. This is an expected result because of the speed 
advantage of target. Figure 4.12 shows the missile and the 
target flight paths. The missile still has the capability to 
follow the target motion. This is due to present geometry 
advantage for the missile and non-maneuvering target motion. 
Applied acceleration and acceleration components are shown in 
Figure 4.13 and Figure 4.14, respectively. The acceleration 
especially in the y direction increases during the initial 
phase. Figure 4.15 is a plot of the line-of-sight angle. Line- 
of-sight rate is shown in Figure 4.16. At initial phase line- 
of-sight rate increases rapidly, then decreases as the missile 


comes to a constant course. 
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Figure 4.12 Missile and Target Trajectories 
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Figure 4.14 Acceleration Components 
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Figure 4.16 Line-of-Sight Rate 
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V. MISSILE APPLICATION OF THIRD ORDER CONTROLLER 


A. MISSILE AND THIRD ORDER REGULATOR 

When the system dynamics in Figure 4.2 are examined, the 
autopilot and the missile dynamics together form a third order 
system. This third order system is basically similar to the 
third order regulator switching function found in Chapter II. 
The difference between the two systems is the factor of V,cosy 
and V,siny between 7 and the acceleration components. 

The autopilot and the missile dynamics together can be 
considered a third order regulator that drives the selected 
states to zero in minimum time as illustrated in Figure 4.1. 
If the right states are chosen to be driven to zero in state- 
Space, the intercept occurs between the missile and the 
target. 

The system signal flow graph of the missile for minimum 
time application is shown in Figure 5.1. In simulation, the 
same initial conditions used in Chapter IV for the speed 
advantage of the target simulation, will be used. The states 
which will be driven to zero are 


- The vertical distance between the missile and target and 
its derivative; 


- The derivatives of line-of-sight angle (a). 
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Figure 5.1 System Signal Flow Graph 
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B. GUIDANCE BY VERTICAL DISTANCE BETWEEN MISSILE AND TARGET 

In the first approach, the states to be driven to zero 
are the vertical distance between the missile and the target 
and the first and second derivatives. The purpose is to force 
the missile to rise to the height of the target in minimum 
time, then turn on the target for head-on-collision. 

Since the V,cosy is a multiplier in y channel of the flow 
graph, it is taken as a scaling factor for finding the 
uncoupled system. The y channel of the system can be 


considered as the following third order regulator: 





Figure 5.2 Missile y Channel as Third Order Regulator 


The differential equations of the system are 


mee a 2 (5.1) 
Y= X, = X; (Si2)) 
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Y = xX, = Vx, = V(-ax, + u) 
v(-«2. a] (5.3) 
V 


= -ax, + uV 


Where V=V,cosy. So the state-space of the system for y channel 


is 


X, O01 0 *1 0 


7 
yl = 1%] =|0 0 1 X,] + lolu (5.4) 
ba 0 0 -al}lx, 


For the uncoupled state-space, the states are defined as 











xX, = bo) 5) 
: s2 Ss S+a ( 
X, = V/« a V/a (5.6) 
s S+o 
V 
= 527 
3 Pre ( ) 
G and G’ matrices are 

V/a -V/a? V/a? a/Vi/Vv 0 
G=!0 V/a -V/al and Gte=|0 a/vil/ (5.8) 

0 0 V 0 0 1/ 
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The uncoupled state-space is 


V; O1 0%: 0 
Belr= |Om0n 0 Vo) > Il \u (5.9) 
W3 00 -ajy, ae 


It is seen that the uncoupled system is the same for the 
third order regulator example in Chapter II. Thus, the 
switching law is the same as in Equation (2.35) for the 
uncoupled state-space. But the transformation from uncoupled 


state-space to normal state-space by Equation (2.36) will be 


different. The uncoupled states in terms of normal states 
are 
4 al 
5 ey ts OY he 
4 1 
Y> = ve + ays (S220) 
ile 
aos v3 ae 


It is seen that all states are divided by V,cos,. 
Therefore, the switching law from Equation (2.38) is obtained 
by dividing the states by V,cos;7. 

After running the simulation, the missile rises to the 
height of the target and then turns onto the target for head- 
on-collision. The flight paths of the missile and the target 


are in Figure 5.3. The range according to time is shown in 
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Figure 5.4. The miss distance is 0.07 feet. The vertical 
distance between the missile and the target according to time 
is shown in Figure 5.5. It is seen that the vertical distance 
1s driven to zero and kept at that value until intercept 
occurs. The acceleration and the acceleration components are 
shown in Figures 5.6 and 5.7, respectively. Acceleration, 
especially at the beginning of flight, is applied at its 
maximum. Acceleration in y direction starts with a high value 


and decreases as the vertical distance decreases. 
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Figure 5.3 Missile and Target Trajectories 
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Figure 5.5 Vertical Distance vs Time 
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Figure 5.6 Applied Acceleration 
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Figure 5.7 Acceleration Components 
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Cc. GUIDANCE BY DERIVATIVES OF o 

The second group of states which is chosen are the 
derivatives of line-of-sight angle (0,0,0). If the 6 is driven 
to zero, the o becomes constant. If the relative velocity is 
decreasing and the line-of-sight is constant, intercept occurs 
between the missile and target. This is the theory of 
Proportional Navigation Guidance and illustrated in Figure 
3.4. 

We can have the o and its derivatives analytically from 
Figure 4.1. In an actual application, these values can be 
estimated by a Kalman filter or a Luenberger observer. Line- 


of-sight angle is given by Equation (4.4). Derivatives of a 


are 
V, - VV. 
Ci ey mea 2 (5. 1b) 
R2 
se ele SEN ACE AIO Ae, (5.12) 


Ree R‘ 


roe (Va, +xXV-V,a,-YX) (R*) -2 (xV,+yV,) (xa,-ya,) 
R¢ 
_2 (Vx+xa,+V,+Vay) (xV,-YV,) +2 (xay-ya,) (xV,+yV,) (5.13) 
R* 
, BAXV,+yV,) ames =U) 


R® 
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Where X = X-Xy Y — Yousyou 


V 


a, = a7,—ay, a, = ay~ay 

After the simulation, we found that the control drives 
the derivatives of o to zero and intercept occurs. Flight 
paths of the missile and the target are shown in Figure 5.9. 
The range is plotted in Figure 5.10. Miss distance is 0.045 
feet. The line-of-sight angle is shown in Figure 5.11. Figure 
5.12 shows the line-of-sight angle rate. It is seen that the 
control drives the line-of-sight angle rate to zero, so the 
line-of-sight is kept constant and intercept occurs. 


Acceleration and its components are shown in Figures 5.13 and 


Sea. 
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Missile 
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Figure 5.9 Range vs Time 
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Figure 5.11 Line-Of-Sight Angle 
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Figure 5.12 Applied Acceleration 





Figure 5.13 Acceleration Components 
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VI. CONCLUSIONS 


A third order minimum time switching law was developed. 
The switching law that was found, was applied to the third 
order fast reaction missile defense problem. The Proportional 
Navigation Guidance is applied to the same problem for 
comparison. 

Minimum time application was established using two 
different approaches. One was with the vertical distance and 
derivatives, the other was the first, second and third order 
derivatives of Line-of-Sight angle. Both approaches gave more 
effective results than Proportional Navigation Guidance. 

Since bang bang control always uses negative or positive 
maximum control effort, another control logic is necessary to 
shut off the control effort when the desired conditions are 
met. Otherwise, the system starts a chattering mode or limit 


cycles. This may be a subject for future projects. 
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APPENDIX 


PROPNAV .M 


Missile/Target engagement simulation 


Target has a non-maneuvering flight 
Program terminates when the range starts to increase 
Miss Distance is found by interpolating the minimum range 


1. 
% 
% Proportional Guidance 
% 
% 
% 


Cclear;clg 
Ne—3.25; 
alp=3; 
maxac=640; 
Am=[0 1 0 
Tele 
oa) 
DOO) 
Pm—({0O 071 0;0 0;0 1j; 
Aa=([-alp); 
Ba=[alp]); 
As=[ 0 ters 
=LOO 6-20); 
Bs=[({ 0;100]; 


0 
e) 


4 DISCRETIZE THE SYSTEM 
dt=0.01; 
(phim,delm)=c2d(Am,Bm, dt) ; 
([phit)=[phim] ;[(delt]=[delm]; 
[phia,dela])=c2d(Aa,Ba,dat) ; 
[phis,dels]=c2d(As,Bs,dat); 


° 


% INITIALIZE THE STATES 


xm(:,1)=[ 0 % xmO 
1000 % xdm0 

0 % ym0O 

Cl % ydmo 

eis, 1)=(10000 % xtO 
-2000 % xdto 

1000 % yto 
0); % ydato 


0 om dO dO 


% 
% 
% 
% 
% 


Navigation Ratio 

1/a = Autopilot time constant 
Allowed maximum acceleration 
Missile state matrices 


Autopilot states 


Seeker states 


Sampling time 
Missile system 
Target system 
Autopilot 
Seeker head 


[x;xd;y;yda) 


[x;xd;y;yd) 


i), 


R(1)=sqrt((xt(1,1)-xm(1,1))*2+(xt(3,1)-xm(3,1))%*2); 


time (1)=0; % Time 
am(1)=0;amx(1)=0;amy(1)=0; %* Acceleration 
gamadmis(1)=0; + Missile flight angle 
beta(:,1)=[0;0); + Seeker head angle 


% BEGIN SIMULATION LOOP 

Tf=15; % Simulation time 

kmax=Tf£/dtt+1; 

for i=1:kmax-1 
v_mis(i)=sqrt(xm(2,1)*2+xm(4,1)%2) ; + Missile velocity 
gama_mis(i)=atan2(xm(4,1),xm(2,1i)); %* Missile vel. angle 
sigma (1,1i)=atan2((xt(3,1)-xm(3,1)), (xt(1,1)-xm(1,1))); 
beta(:,i+1)=phis*beta(:,1)+dels*sigma(i); 

%* Input For the Autopilot=betadot*Nr 

gamadmis(i+1)=phia*gamadmis(i)+dela*Nr*beta(2,1i+1) ; 

Missile Acceleration 

am(it+1)=v_mis(i)*gamadmis(it1) ; 

if abs(am(i+1)) > maxac % Check for max. acceleration 
am(it+1)=maxac*sign(am(it1)); 

end 

Acceleration is perpendicular to gama 

u(:,1+1)=[-sin(gama_mis(i))*am(it1) ; 

cos(gama_mis(i))*am(itl)]j; 

Update missile & target states 

xm(:,1+1)=phim*xm(:,1)+delm*u(:,1i+1); 

Xt(:,1+1)=phit*xt(:,1)+delm*[0;0]j; 


oe 


oo 


oe 


R(it1)=sqrt((xt(1,i+1)-xm(1,1+1))*2+(xt(3,i+1)-xm(3,1+1))%*2); 
time (i+1)=time(i)+dt; 


io) 


% Check for the min. distance 
if abs(R(i+1)) > abs(R(i)) 
xms=(xm(3,1-1:1+1) ;xm(4,1-1:14+1) ;xm(1,1-1:141) ;xm(2,1-1:141)]; 
Xts=(xt(3,17-1:1i+1) ;xt(4,1-1:141) ;x€(7,1-1:1+1) ;xt(2,1-1:15ae 
ri = interp(oms(:,1:2)-xtst- a2), % (Ref. 5] 
r2 = interp(omsi(: 72:3) xtaeee ee 
rmin=min((rl1 r2)); 
break % Terminate if distance is min. 
end 
end 
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PLOT RESULTS 


Flight paths of missile and target 

eric ct ( 1, ts 1-day) XC (3) 1s 1+] jepm (lol s 1 +1) , xm (Beek 2 1+) 
title(’Flight Paths’); 

gtext({’rmin = ’,num2str(rmin) }]) ;pause 


Acceleration Components 
mot (time(1:1),u(@,1:1),time(1:1),u(2,1:1)); 
title(’Acceleration Components’ ) ;pause; 


Missile acceleration 
plot (time(1:i+1) ,am(1:i+1)); 
title(’Missile Acceleration’ ) ;pause; 


Line-of-sight rate 
fpeot(time(1:1),beta(2,1:1)); 
title(’Line-of-Sight Rate’) ;pause 


Line-of-Sight angle 
plot (time(1:1),sigma(l1:1)); 
title(’Line of sight’) ;pause 


Range 


plot (time(1:i+1) ,R(1:1i+1) ) 
title(’Range’ ) 
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2. YYDYDD.M 

% Missile/Target engagement simulation 

% Control by Third Order Minimum Time Controller 

% Control States: Vertical Distance and derivatives 

% Missile acceleration limited to 640 ft/sec’ 

% Program terminates when the range starts increasing 

%$ Miss Distance is found by interpolating minimum distance 


Clear;clg 
alp=3; % 1/alp = Autopilot time constant 
N=1; 
maxac=640; 
Am=[0 1 0 O; % Missile matrices 
0 0 
0 0 
000 0}; 
Bm=[{0 0O 0;0 0;0 1 iy 
Aa=[0 us %* Autopilot states 
0 -alp); 
Ba=[O;alp]; 
% DISCRETIZE THE SYSTEM 
at=0.01; % Sampling time 
{[phim, delm]=c2d (Am, Bm, dat) ; 
[phit]=[phim]; 
[deltj=[delm]; 
[phia,dela]=c2d(Aa,Ba,dat) ; 
% INITIALIZE STATES 


xm (> 7 92) — 0 roe % xmO 
1000 1000; % xdamO 

0 0; % ymoO 
0 Ol; % yamO 

XE(:,1:2)=[ 10000 9980: % xto 
-2000 -2000; % xdto 

1000 1000; % yto 

0 GO) % ydto 


R(1) =sqrt (.@xt (1,1) ~xm (ed) 24+ Geese eee, 
R(2)=sqrt((xt(1,2)-xm(1,2)) °*2+(xt(3,2)-xm(3,2))°2); 
time(1:2)=[0 0]; 
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gmis(1)=0; 

gamamis(:,1:2)=(0 0;0 0j; 
amy(1:2)=[0 0]; 
v_mis(1)=1000;aax(1)=0;aay(1)=0; 
% SWITCHING LAW 


ax=0; ay=0; 
Vx=(xt(2,1)-xm(2,1)); Vy=xt (4,1)-xm(4,1); 
X=(xt(1,1)-xm(1,1)); y=xt(3,1)-xm(3,1) ; 


xS1(1)=y; x*s2(1)=Vy; xs3(1)=0; 
u(1)=N*swth_law(xsl1,xs2,xs3,alp,N) ; 
%BEGIN SIMULATION LOOP 
Tf=15; 
kmax=Tf/dt+1; 
for i1=2:kmax-1 
% Missile velocity 
V_mis(i)=sqrt(xm(2,1)*2+xm(4,1)%*2); 
gmis(i)=atan2(xm(4,1i),xm(2,1)); 
moat) —(Xt(3,1)—-xm(3,1))/(v_mis(1) *cos(gmis(1))); 
XS2(1)=(xt(4,1)-xm(4,1))/(v_mis(1)*cos(gmis(1i))); 
xXxS3(1)=-gamamis(2,1) ;%-amy(i) ;% 
u(i)=N*swth_law(xs1(i),xs2(1),xS3(1),alp,N) ; 
* Input for the autopilot = u 
gamamis(:,i+1)=phia*gamamis(:,1)+dela*u(i); 
% Miss:le acceleration 
am(i+1)=v_mis(i) *gamamis(2,1+1); 
if abs(am(it1l)) > maxac 
am(it+1)=maxac*sign(am(itl) ); 
end 


% Acceleration components 
amx(i+1)=-am(it+1)*sin(gmis(i)); 
amy (1i+1)= am(it1)*cos(gmis(i)); 


%* Update missile and target states 
xm(:,i+1)=phim*xm(:,1i)+delm*({ amx(itl); amy(itl1) Jj; 
Xt(:,1+1)=phit*xt(:,i)+delm*[(0;0); 


R(it+1)=sqrt((xt(1,i+1)-xm(1,i+1))*2+(xt(3,i+1)-xm(3,i+1))%*2); 


time (i+1)=time(i)+dt; 
if (abs(R(i+1)) > abs(R(i))) 
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xms=[xm(3,1-1:i+1) ;xm(4,1-1:14+1) ;xm(1,1-1:141) ;xm(2,1-1:1i+1) j; 


xts=(xt(3,i-1:1i+1) ;xt(4,1-1:14+1) ;xt(1,1-1:14+1) ;xt(2,1-1:1+1) J; 
ra = interp(xms @,12:2) ,xts(-7122))4 % (Ref. 5] 
r2 = interp(xms(:,2:3),xts(:,2:3)); 
rmin=min([{rl1 r2)); 
break 

end 
end 


% PLOT RESULTS 

% Flight paths 

plot (xm(1,1:3:i+1) ,xm(3,1:3:1i+1) ,xt(1,1:3:it+1) ,xt(3,1:3:1i+1) ) 
title(’Flightpaths’); 

gtext([’rmin=’,num2str(rmin) }) ;pause; 


% Control input 

axis([O time(i)+0.1 -N-N/10 N+N/10}) 
plot(time(1:2:1),u(1:2:1) ,time(i:2:1), ut): 2: eae 
title(’U’) ;pause;axis; 


% Missile acceleration 

axis({O time(1)+0.1 -maxac-maxac/25 maxac+maxac/25)) 
plot (time(1:2:i+1),am(1:2:1i+1)); 

title(’Missile acceleration’ ) ;pause;axis; 

% Missile velocity angle 

plot (time (1:2:1) ,qmme@ Pf: 2:1). 

title(’Gama’); 

pause; 


% Missile velocity 
plot (time (1:2:1),v_mis(132:1) ,time(1:2:3),V mis (122 ee 
title(’Missile velocity’) ;pause 


% y states 

plot (time (1:2:1)) xt(3, 12222) —sis ee 
title(’(Y_target - Y_ missile vs Time ’); 
pause; 
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SIGMDER.M 


Missile/Target engagement simulation 
Control by Third Order Minimum Time Controller 


Missile acceleration limited to 640 ft/sec’ 
Program terminates when the range starts increasing 
Miss Distance is found by interpolating minimum distance 


clear;clg 
alp=3; 

N=1; 
maxac=640; 
Am=[0 1 0 0; 


@ 0 0 0; 

OmOmo 1; 

00 0 0}; 
Bm=[0O 0; 

ie Os 

O 0; 

O01); 
Aa=[0 aL; 

0 -alp); 
Ba=(O;alp]}; 
dt=0.01; 
mE—25; 


kmax=Tf/dtt+1; 


$ INITIALIZE STATES 


mcs, 1l)=[ O; 
Oo OO; 
0; 
Oj}; 
,l)=[{ 10000; 
-2000; 
LOO > 
07}; 
>,2)=( 10; 
1000; 
0; 
07); 
9966; 


Bote. (S 


xt ($ 


OP HP HO 


OP HW dP A HP HP HW HO HW dP 


xmoO 
xdm0 
ymo 
ydamo 
xto 
xdto 
yto 
ydto 
xmO 
xdmo0 
ymo 
ydmo 
xto 
xdto 


3. 

% 

% 

% Control States: Derivatives of Sigma 

% 

% 

% 

% Missile matrices 


%* Autopilot states 
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1000; % yto 
Oj % ydato 

R(1)=sqrt ((xt(1,1) =—xm(1,1) )°24(x 0 (6 ae) eZ); 
R(2)=sqrt((xt(1,2) -xm(1,2) )*2+(xt(3,2)-xm(3,2))%*2); 
gQamamis(:,1:2)=[(0 0;0 Oj; 
am(1:2)=({0 O)]J;amx(1:2)=[{0 Oj}; amy(1:2)=[0 0}; 
time(1:2)=[(0 dt]; 
(phim,delmj=c2d(Am,Bm, dt) ; 
(phit]=[(phim]; 
(deltj=(delm]; 
(phia,dela]J=c2d(Aa,Ba,dat) ; 
V_mis(1)=1000;aax(1)=0;aay(1)=0; 


ax=0; ay=0; 
Vx= (Qub(2 scm (2 ee Vy=xt (4,1)-xm(4,1); 
x=(xt(1,1)-xm(1,1)); y=xt (3,1)-xm(3,1); 


Ssigma(1,1)=atan2(y,x); 
Sigma(2,1)=(Vy*x-Vx*y) /(x°2+y 2); 
Ssigma(3,1)=(ay*x-ax*y) /R(1) *2-2* (x*Vx+y*Vy) * (x*Vy-y*Vx) /R(1) 
4: 
sigma(3,1)=(ay*x-ax*y) / (x*2+y%*2) -2* (x*Vxt+y*Vy) * (x*Vy-y*Vx) / ( 
MO2tye 2) 2 
XxS1(1)=sigma(2,1);xs2(1)=sigma(3,1);xs3(1)=0; 
u(1)=N*swth_law(xsl1,xs2,xs3,alp,N) ; 
for 1=2:kmax-1 
% Missile velocity 
v_mis(1)=sqrt(xm(2,1)*2+xm(4,1)%2) ; 
gama_mis(i)=atan2(xm(4,1i),xm(2,1)); 


ay=-amy (1); ax=-amx(i); 
Vy=xt(4,1)-xm(4,1); Vx=(xt(2,1)-xm(2,1)); 
y=xt(3,1)-xm(3,1); x=(xt(1,1)-xm(1,1)); 


aay (i)=(-amy(i-1)+v_mis(i-1) *cos(gamamis(1,1))*u(i-1)); 
aax(i)=(-amx(1i-1)+v_mis(i-1) *sin(gamamis(1,1))*u(1i-1)); 
Sigma(1,1)=atan2(y,x) ; 

Sigma (2,1)=(Vy*x-Vx*y) / (x*2+y%2) ; 


Sigma (3,1i)=(ay*x-axty) /(x*2+y*2) -2* (x*Vx+y*Vy) * (x*Vy-y*Vx) / ( 
x°24+Y 22) o2e 
XS1(1)=sigma(2,1);xs2(1)=Sigma(3,1); 
XS3(1)=(Vx*ayt+x*aay (1) -Vy*ax-y*aax(1))/R(1)*2-... 
2* (x*¥Vxt+y*Vy) *(x*ayry*ax) /R(1)*4-... 
2*((VxX*24+xX¥ axtVy*2+y*ay) * (x*¥Vy-y*VxX) + (x*ay-y*ax) *(xX*¥VxXt+yFVy) 


) (RGIS 4+. 2; 
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8k (X*¥Vx+y*VYy) *2* (x*Vy—-y*VxX) /R(1) °*6; 
u(i)=N*swth_law(xs1(i),xs2(1),xs3(1i),alp,N) ; 
% END SWITCHING LAW 
% Input for the autopilot = u 
gamamis(:,i+1)=phia*gamamis(:,1)+dela*u(i) ; 
% Missile acceleration 
am(i+1)=v_mis(i) *gamamis(2,1+1) ; 
if abs(am(it1)) > maxac 
am(i+1)=maxac*sign(am(it+1l) ); 
end 
% Acceleration components 
amx (i+1)=-am(i+1)*sin(gamamis(1,1+1) ); 
amy (i+1)= am(i+1)*cos(gamamis(1,i+1) ); 
%~ Update missile and target states 
xm(:,1+1)=phim*xm(:,i)+delm*{ amx(itl); amy(it+l1)]; 
xt(:,1+1)=phit*xt(:,1)+delm*[0;0]; 


R(it+1)=sqrt((xt(1,i+1)-xm(1,1+1) )*2+(xt(3,1+1) -xm(3,1+1))%*2); 
time (it+1)=time(i)+dt; 
if (abs(R(1it+1)) > abs(R(i))) 


xms=(xm(3,171:1+1) ;xm(4,1-1: 141) ;xm(1,1-1:14+1) ;xm(2,1-1:1+1) ); 


fee— (xt (3, 1—12itl) -xt(4, 1-1:141) swt (191-1: 141) ;xt(2,1-1:1+1) j; 
mio. Mieenp( xMsi 2,13 2) oxts( 2) lise) % (Ref. 5] 
mee INnterp(xms(: ,2:3),xts(:,238)); 
rmin=min(({rl r2}); 
break 

end 
end 
% PLOT RESULTS 

% Flight paths 

ceborext be 3ca+1),xXt(3,1:3:1i+1),’*! ,xm(1,1:3:141),xm(3,1:3: 

i+1)) 

title(’Flight paths’); 

gtext([’rmin=’,num2str(rmin) }); 

pause; 

% Control input 

Puomerinerely2 st) wc ls?2:1), tame(l: 22:3), u(1ls2:1),'’*’); 
title(’U’); 
pause; 
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% Missile acceleration 


plot (time(1:2:14+1) ,am(1:2:1+1) ,time(@@:2:141), aml: 2a 1) x 

title(’Missile acceleration’); 

pause; 

% Missile velocity angle 

plot (time(1:2:1),gamamis(1,1:2:1),time(1:2:1),gama_mis(1,1:2 

cS rh) 

title(’Gama’) ;xlabel(’Time’) ;ylabel(’Radian’ ) 

pause; 

% Missile velocity 

plot (time(1:2:1),v_mis(1:22a)9time(1:2:1) Vv mis(?: 2-1) age 

title(’Missile velocity’); 

;pause 

% y states 

plot(time(1:2:1),xt(3, 1:22:17) =o, 1-2: ee, 

title(’(Y_target - Y_missile) vs Time’) ;pause;%meta sigcd6é 

% range 
plot(time,R) ;title(’range’) ;pause;%#meta range 

% sigma 

plot (time(1:1),sigma(1,1:1));title(’sigma’); 

pause; 

% Sigmadot 
plot(time(1:1),sigma(2,1:1));title(’sigmadot’) ;pause 
meta sigmadot 
plot(time,amx,time,amy) ;title(’comp.’) ;pause;%meta comp 
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4. SWTH LAW.M 
% Function calculates the sign of the control 


function[s)=swth_law(x1,x2,x3,alp,N) ; 

w=Sign( (alp*x1+x2)+((alp*x2+x3) *abs (alp*x2+x3)/(2*N))); 

f=(alp*x1+x2) +w* ((alp*x2+x3)*2/(2*N)); 

z=sqrt(abs(f)/N); 

s=sign(w* ((N*exp(alp*z) /alp)-(2*N/alp) )+((exp(-alp*z)*... 
exp (-w*alp* (alp*x2+x3) /N) )*(x3+w*N/alp) )); 
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[1] 


[2] 


(3 ] 
[4] 
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